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CLAIMS 

We claim: 

1 . ^ method for enhancing video, comprising the steps of: 
5 identifying one or more positions in a first image; 

convertingXsaid one or more positions to one or more locations in 
relation to a virtual surface; 

converting saiM one or more locations in relation to said virtual surface 
to one or more positions in a second image; and 
10 enhancing said second image based on said one or more positions in said 

second image. 

2. A method according to claim 1, wherein: 



said virtual surface is a sphere. 



3. A method according to claim 2, wherein: 

said first image and said second image are video images; 

said first image depicts an environment having an actual surface; 

said second image depicts said actual surface; 
20 said one or more positions in $aid first image are on an image of said 

actual surface in said first image; \ 

said one or more locations are \hree dimensional locations on said 
sphere; \ 

said one or more positions in said second image are on an image of said 
25 actual surface in said second image; \ 

said step of enhancing includes editing s^id second image in relation to 
said one or more positions in said second image; 

said step of converting said one or more locations is based on camera 
sensor data; and 
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said camera sensor data pertains to an attitude of a camera capturing said 
second image. 

4. AVmethod according to claim 1, wherein: 
5 said step of identifying includes using a pointing device to select one or 

more pixels on a monitor. 

5. A method according to claim 1, wherein: 

said step of identifying includes using a pointing device to select one or 
10 more pixels on a monitor and using said selected pixels to determine said one or 
more positions in a first \image 



6. A method according to claim 1 ? wherein: 

said step of identifying includes selecting a region of said first image. 



15 



7. A method according to claim 1 , wherein: 
Aatic 



said one or more locations are three dimensional locations on said 
virtual surface. 

20 8. A method according to claim 1 , wherein: 

said one or more locations We all on said virtual surface. 



9. A method according to claim 1, wherein: 
said second image depicts an\environment; 
25 said second image is captured by a camera; and 

said step of converting said orle or more locations is performed without 
surveying a position of said camera in relation to said environment. 



1 0. A method according to claim 1 , wherein: 
30 said second image depicts an environment having an actual surface; 
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said Jme or more positions in said second image are on an image of said 
actual surface m said second image; and 

said step\of converting said one or more locations are performed without 
knowing a distance between said first actual surface and a camera capturing said 
5 second image. 

11. A metliod according to claim 1 , wherein: 
said step of converting said one or more locations is based on camera 
sensor data; and \ 
10 said camera sensor data pertains to an attitude of a camera capturing said 

second image. 



12. A method according to claim 1 5 wherein: 

said step of converting^ said one or more locations is based on camera 
1 5 sensor data and stabilization offset data; 

said camera sensor data pertains to an attitude of a camera capturing said 
second image; and 

said stabilization offset data\is used to correct said camera sensor data. 



20 13. A method according to\claim 12, further comprising the steps of: 

identifying positions of edges; 
transforming said positions of\said edges to edge locations on said 
virtual surface; 

transforming said edge locations to edge positions in said second image 
25 using said camera sensor data; \ 

determining said stabilization offset ^ata based on a difference between 
said transformed edge positions in said second image and actual edge positions 
in said second image. 

30 1 4. A method according to claim 1 , wJierein: 
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said steA of enhancing includes adding an enhancement image to said 
second image and accounting for occlusions of said enhancement image. 

15. A method according to claim 14, wherein: 

said step on accounting for occlusions of said enhancement image 
includes accessing a color map and editing pixels of said second image 
according to said colon map. 



16. A method according to claim 14, wherein: 
10 said second image is an image of an environment having an actual 

surface; and 

said enhancement image appears to be on said actual surface. 



17. A method according to claim 1, further comprising the steps of: 
15 converting said one or^more locations in relation to said virtual surface 

to one or more positions in a third image; and 

enhancing said third image based on said one or more positions in said 
third image. 



20 1 8. A method according to claim 1 , wherein: 

said first image and said second image are video images; 

said first image depicts an environment having an actual surface; 

said second image depicts said actual surface; 

said step of identifying includes annotating an image of said actual 
25 surface in said first image, said one or more positions represent said annotation, 
said annotation is at a first orientation in relation to said actual surface; and 

said step of enhancing includes adding said annotation to an image of 
said actual surface in said second image\at said first orientation in relation to 
said actual surface. 

30 
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19. A Vnethod according to claim 18, wherein: 

said step Of annotating an image includes receiving a set of points from a 
touch screen. 

20. A method according to claim 1, wherein: 
said step of identifying one or more positions in a first image include 

identifying a position to add a virtual advertisement; 

said step of converting said one or more locations includes determining 
where to add said virtual advertisement into said second image; and 

said step of enhancing includes adding said virtual advertisement into 
said second image. 



21. A method according to claim 1 , wherein: 

said step of identifying one or more positions in a first image include 
identifying a set of positions in an environment, said set of positions bound a 
virtual advertisement; ^ 

said step of converting said one or more positions includes transforming 
said set of positions in said environment to locations on said virtual surface; 

said step of converting^said one or more locations includes determining 
where said set of positions are in said second image; and 

said step of enhancing includes adding said virtual advertisement into 
said second image where said set\of positions are in said second image. 



22. A method for enhancing video, comprising the steps of: 
determining one or more locations in relation to a virtual surface; and 
converting said one or more locations in relation to said virtual surface 

to one or more positions in a video image. 

23. A method according to claim 22, further comprising the steps of: 
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enhariping said video image based on said one or more positions in said 
video image. 

24. A Wethod according to claim 23, wherein: 
said step o\ enhancing includes adding an enhancement image to said 
video image and accounting for occlusions of said enhancement image. 



25. A method according to claim 22, wherein: 
said virtual surface is a sphere; and 
10 said one or more t locations are three dimensional locations on said 

sphere. 



26. A method according to claim 22, wherein: 
said video image depicts an environment; 
15 said video image is capti^red by a first camera; and 

said step of converting said one or more locations is performed without 
knowing a position of said first camera in relation to said environment. 



27. One or more processor readable storage devices for storing 
20 processor readable code, said processor readable code for programming one or 

more processors to perform a method comprising the steps of: 

\ 

determining one or more locations in relation to a virtual surface; and 
converting said one or more locations in relation to said virtual surface 



25 



to one or more positions in a video image. 



28. One or more processor readable storage devices according to 
claim 27, wherein said method further comprises the steps of: 

enhancing said video image based on said one or more positions in said 
video image. 



30 
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29. \ One or more processor readable storage devices according to 
claim 28, wherein: 

said step of enhancing includes adding an enhancement image to said 
video image and^ccounting for occlusions of said enhancement image. 

30. One or more processor readable storage devices according to 
claim 27, wherein:^ 

said virtual surface is a sphere; and 

said one or more locations are three dimensional locations on said 



1 0 sphere. 

31. One or more processor readable storage devices according to 
claim 27, wherein: \y 

said video image depicts an environment; 
1 5 said video image is Captured by a first camera; and 

said step of converting said one or more locations is performed without 
knowing a position of said first camera in relation to said environment. 



32. One or more processor readable storage devices according to 
20 claim 27, wherein said method further comprises the steps of: 

storing one or more positions in a first image, said step of determining 
includes converting said one or more positions to said one or more locations in 
relation to said virtual surface; and 

enhancing said video image based on said one or more positions in said 
25 video image. 



33. One or more processor readable storage devices according to 
claim 32, wherein: 

said first image is a video image; 
30 said first image depicts an environment having an actual surface; 
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said vicfleo image depicts said actual surface; 
said step\of storing includes storing an annotation of an image of said 
actual surface, said one or more positions represent said annotation, said 
annotation is at a first orientation in relation to said actual surface; and 
5 said step oft enhancing includes adding said annotation to an image of 

said actual surface ix\ said video image at said first orientation in relation to said 
actual surface. 

34. One or more processor readable storage devices according to 
10 claim 32, wherein: ^ 

said step of storing includes storing a set of positions in an environment, 
said set of position bound V virtual advertisement; 

said step of converting said one or more positions includes transforming 
said set of positions in said environment to locations on said virtual surface; 
15 said step of converting said one or more locations includes determining 

where said set of positions are\in said second image; and 

said step of enhancing\ includes adding said virtual advertisement into 
said second image where said se^of positions are in said second image. 

20 35. An apparatus for enhancing video, comprising: 

video modification hardware; and 

one or more processing devices in communication with said video 
modification hardware, said one or\more processing devices perform a method 
comprising the steps of: 
25 determining one or moYe locations in relation to a virtual surface, 

and ^ 

converting said one or more locations in relation to said virtual 
surface to one or more positions in a video image. 
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36\ An apparatus according to claim 35, wherein said method further 
comprises the steps of: 

enhancing said video image based on said one or more positions in said 
video image. 

37. An>apparatus according to claim 35, wherein: 
said step on enhancing includes adding an enhancement image to said 
video image and accounting for occlusions of said enhancement image. 



10 38. An apparatus according to claim 35, wherein: 

said virtual surface is a sphere; and 
said one or more locations are three dimensional locations on said 

sphere. 



15 39. An apparatus according to claim 35, wherein: 

said video image depicts an environment; 
said video image is captured by a first camera; and 

said step of converting said one or more locations is performed without 
knowing a position of said first camera in relation to said environment. 
20 ^ 

40. An apparatus according to claim 35, wherein said method further 
comprises the steps of: 

storing one or more positions\in a first image, said step of determining 
includes converting said one or more ppsitions to said one or more locations in 
25 relation to said virtual surface; and 

enhancing said video image based^ on said one or more positions in said 
video image. 

41. An apparatus according to claim 40, wherein: 
30 said first image is a video image; 
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saM first image depicts an environment having an actual surface; 
saicnvideo image depicts said actual surface; 

said step of storing includes storing an annotation on an image of said 
actual surfaca in said first image, said one or more positions represent said 
annotation, sai^ annotation is at a first orientation in relation to said actual 
surface; and 

said step of enhancing includes adding said annotation to an image of 
said actual surface \n said video image at said first orientation in relation to said 
actual surface. 



42. An apparatus according to claim 40, wherein: 

said step of storing includes storing a set of positions in an environment, 
said set of position bound^a virtual advertisement; 

said step of converting said one or more positions includes transforming 
15 said set of positions in said environment to locations on said virtual surface; 

said step of converting said one or more locations includes determining 
where said set of positions are\in said video image; and 

said step of enhancing\includes adding said virtual advertisement into 
said video image where said set of positions are in said video image. 
20 ^ 

43. An apparatus according to claim 35, further comprising: 
camera sensors; \^ 

a gatherer computer, said gatherer computer receives camera sensor data 
from said camera sensors; \y 
25 a time code inserter, said time code inserter receives video and adds time 

codes to said video; and \^ 

a touch screen, said one or more processing devices include a first 
processor and a second processor, said first processor receives camera sensor 
data from said gatherer and video from \said time code inserter, said first 
30 processor also receives annotation data fromysaid touch screen, said annotation 



Attorney Docket No.: SPTV-01068US0 
Z:\sptv\1068\1068.app.doc 



-63- 

data relates to a Vet of positions on said touch screen, said first processor 
converts said positrons on said touch screen to said one or more locations in 
relation to said virtual surface, said first processor sends drawing information to 
said second processorAsaid drawing information is based on said one or more 
positions in said vide© image, said second processor directs said video 
modification hardware ta add one or more annotation image to said video 
image, said annotation ima&e corresponds to said annotation data, said step of 
converting said one or more locations is based on said camera sensor data. 



10 
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44. An apparatus according to claim 35, further comprising: 

camera sensors, said camera sensors provide camera sensor data to said 

one or more processors, said step^ of converting said one or more locations is 

based on said camera sensor data. 
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